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A METHOD FOR GENERATING NTJMERICAL PILOT OPINION RATINGS 
USING THE OPTIMAL PILOT MODEL 
Ronald A. Hess* 

Ames Research Center 

t 

INTRODUCTION 


Background 

The optimal-control model of the human operator has been shown to be a 
useful tool in the analysis of pilot-vehicle systems [1-3]. The model has 
been used in a variety of research efforts and has demonstrated a capability 
of generating estimates of pilot performance ranging from simple root-mean- 
square (RMS) tracking performance to instrument scanning behavior. Model- 
based measures of workload have also been proposed and utilized [4,5]. This 
report summarizes a research effort aimed at empirically extending the capabil- 
ities of the optimal pilot model to allow the generation of numerical handling 
qualities ratings utilizing the Cooper and Cooper-Harper rating scales [6,7]. 
Since numerical pilot ratings constitute the ultimate evaluation of any new 
aircraft, a pilot model which generates such ratings is particularly desirable. 

The concept of generating pilot ratings using analytical pilot models is 
not new. Most previous studies, however, e.g. [8-10], have centered' upon the 
classical frequency domain pilot representations as discussed in [11], whereas 
this study utilizes the state-space optimal control model. Since the optimal 
pilot model is finding Increased utilization In man-machine system analysis, a 
rating generation capability would be quite useful. ^ 

A detailed description of the optimal pilot model, itself, is beyond the 
scope of this report. The reader is instead referred to [1] for specifics. 
However, the basic hypothesis behind the model can be given as follows; 

Subject to his inherent limitations, the well trained, well motivated 
pilot, behaves in an optimal manner. The pilot's control characteristics can 
be modeled by the solution of an optimal linear control and estimation problem, 
with certain specifications. As utilized in this study, ‘ these specifications 
can be summarized as follows; 

(1) Time Delay - A pure time delay is included in each of the pilot's 
control outputs. 

(2) Neuromuscular Dynamics - Each output neuromuscular system .is modeled 
as a first-order lag, or equivalently, control rate appears in the quadratic 
index of performance. 


*0n assignment from Naval Postgraduate School, Monterey, Calif. 
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(3) Observation and Motor Holse - Each variable which the pilot observes 
from his display is assumed to contain pilot- induced additive white noise which 
scales with the variance of the observed variable. Each control output is 
assumed to contain pilot- induced additive white noise which scales with' the 
variance of the control. 

(4) Rate Perception - If a variable is displayed explicitly, the pilot 
also perceives the first derivative of the variable but no higher derivatives. 
The first derivative of the displayed variable is also noise contaminated. 

The placement of the pilot time delay at the control output constitutes 
the only major deviation from the model of Kleinraan et al. Here, the delay 
is represented by a Fade' approximation and is treated as part of the plant 
dynamics. The model of [1] subsumes the delay into the observation process. 

The only advantage which the Fade' approximation affords is that it allows 
direct use of existing computational algorithms for the solution of optimal 
estimation and control problems. 

In what follows, a "displayed" variable will refer to a variable explicitly 
displayed to the pilot by the position of a display indicator. A "perceived" 
variable will refer to the time rate of change of a displayed variable. An 
"observed" variable will refer to either a displayed or perceived variable. 
Figure 1 Is a block diagram of a pilot— vehicle system. 


Rating Hypothesis 

Perhaps the most critical step in formulating the optimal pilot model' 
lies in the selection of weighting matrices for the quadratic • index of 
performance: 


J - El 


lim 

T-+«o 




[ y'^(t) £ y(f) + u^Ct) R u(t) ]dt 


Here, y(t) represents a linear combination of system states, i.e., 

y(t) = C' x(t) 

In order to enhance the face value of the rating scheme to be described, the 
variables selected for inclusion in the vector y (t) need to be directly 
observable by the pilot. In this study, u(t) represents the pilot control 
motions before the time delay and neuromuscular dynamics are encountered in 
figure 1. It is assumed that u(t) is observable by the pilot in all cases. 
The selection of the elements of the £ and R matrices is not a trivial step. 
In this study, the elements of these diagonal matrices were selected on the 
basis of maximum "allowable" deviations of the variables included in y (t) 
and u(t) . Such a selection scheme is suggested in [12] for optimal control 
problems in general and utilized in [4] for the optimal model. 
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The pilot rating hypothesis to be investigated can be stated as follows : 

IF 

(1) the index of performance and model parameters in the optimal pilot 
modeling procedure yield a dynamically representative model of the human pilot, 

(2) the variables selected for inclusion in the index of performance are 
directly observable by the pilot, 

(3) the weighting coefficients in the index of performance are chosen as 
the squares of the reciprocals of maximum "allowable" deviations of the 
respective variables, and 'these deviations are 'Consonant with the task as per- 
ceived by the pilot, 

THEN 

The numerical value of the index of performance resulting from the model- 
ing procedure can be related to the numerical pilot rating which the pilot 
assigns to the vehicle and task by 

R = R(J)g 

where R(J)g represents a monotonic function of the value of the index of 
performance J. The subscript ’s’ denotes the particular rating scale being 
utilized by the pilot. 

Implicit in the hypothesis is the assumption that once the function 
R(J)g has been found for a specific scale ’s’, it can be utilized to assign 
pilot ratings to any vehicle and task, provided, of course, that the assump- 
tions (l)-(3) are met. 

The possibility that a correlation exists between pilot performance and 
pilot ratings has been indicated in the literature. McDonnell demonstrates 
this in an experimental study using simple controlled elements [13] and Teper 
in adapting a rating functional for "Paper Pilot" using VTOL aircraft dynamics 
[14]. The idea that a single rating function is applicable to any task is not 
unreasonable in view of the manner in which the index of performance is 
defined. First, the index contains only variables observable by the pilot and 
further. only variables whose deviations are considered pertinent to the task. 
Second, these variables are normalized with respect to maximum allowable 
deviations where these allowable deviations are consonant with the vehicle and 
task as perceived by the pilot. 


Testing the Hypothesis 

The a'nalytical study which follows does not constitute a proof of the 
preceding hypothesis. Indeed, the empirical nature of the analysis precludes 
such a proof. Rather, the hypothesis was tested in the following manner; 
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First, the data from a well documented experimental study, [13], was used 
with optimal pilot modeling results to ascertain whether a rating function 
R(J)g exists for a single-axis compensatory tracking task, employing a single 
controller and display element. 

Second, the data from an experiment involving a more complex task (longi- 
tudinal helicopter hover) , two controllers (longitudinal cyclic and collective) 
and an integrated cathode-ray-tuhe (CRT) display with several elements was 
used along with modeling results to compare model generated ratings with pilot 
generated ratings. 

Third, the ability of the rating scheme to assign a general flying quality 
level, as per [15] was investigated using the data from another complex task 
(longitudinal helicopter landing approach), two controllers (longitudinal cyclic 
and collective) and a CRT display. 

Finally the data from the simulation of another helicopter in hover [14] 
with a single controller (longitudinal cyclic) and a CRT display, was utilized 
to compare pilot and model generated handling qualities ratings. 

In each of these cases, the primary difficulty in applying the rating 
hypothesis was in determining whether a dynamically -representative model of 
the human pilot had been obtained. Determining the validity of any pilot model 
usually involves comparing characteristics of model generated closed-loop 
signals with those from piloted simulation. The signal characteristics used 
in any comparison can be ranked in terms of the information they convey about 
the signals themselves. For example, the average power in a signal conveys 
less information about the signal than does its power spectral density, which, 
in turn conveys less information than the signal time history itself. Thus, a 
pilot model whose validity was based upon comparisons of model generated and 
experimental mean square signal values would inspire less confid^ce than a 
model whose validity rested upon describing function comparisons (essentially 
obtained from power and cross power spectral densities) . In turn, the latter 
model would defer to one whose validity rested upon a direct comparison of 
signal time histories. 

Experimental pilot describing function data was obtained in only the first 
of the simulation studies mentioned above. Thus, the validity of the pilot 
models to be developed' for the helicopter approach and hover tasks will rest 
upon favorable comparison of model generated and experimental RMS tracking 
scores. 


EATING FUNCTION 


Data Base 

The data for the first part of this study was taken from [13] , a well 
-documented investigation of pilot rating techniques. Mean square error scores, 
pilot describing functions and various numerical pilo't ratings were collected 
for a variety of simple controlled elements in compensatory, single-axis 
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laboratory tracking tasks. Figure 2 is a block diagram representation of this 
task. No.te that the primary task is single-axis in nature. The secondary 
task was included to measure excess control capacity with a cross-adaptive 
algorithm and was not utilized in the tracking runs pertinent to this study. 

The commanded input 6^, was obtained as the sum of sinusoids. The amplitudes 
and frequencies of the particular input pertinent to this study are shown in 
table 1. The primary task was represented as a longitudinal tail-chase condi- 
tion for a gunnery run in air conibat. The lead aircraft was taking evasive 
action. The seven primary task controlled elements pertinent to this study 
are shown in table 2. These seven elements were chosen since the associated 
pilot ratings spanned the ranges of the rating scales of interest. 

A fixed base simulator was utilized with a CRT display and fighter- 
aircraft type center-stick. The display is shown in figure 3 with the lead 
aircraft’s wings represented by the moving line. An analog computer generated 
the controlled element d 3 mamics. The eye-to-display distance was about 46 cm. 

A total of forty-four configurations (a configuration consisting of a specific 
controlled element and input) were presented to the pilots in a random 
sequence. As indicated previously, only the data of seven of the configura- 
tions were of interest here. For each configuration, the pilot had to perform 
two sequential tasks, only the first of which is pertinent to this study. For 
the first task, he was asked to track longitudinally to minimize the pitch 
error. During this 120 sec period, the secondary task was inoperative and the 
pilot was asked to formulate his opinion of the configuration based on the 
task performance criterion stated as follows: 

"Best gunnery results will probably be obtained if error is kept less 

than .75 cm." 

Approximately 15 sec were allowed before each run for the subject to reach 
steady-state tracking so that the first 100 sec portion of the 120 sec run 
would be suitable for describing function computations and performance mea- 
sures. At the completion of the 120 sec run, the pilot was asked to write 
down the ratings on a clipboard. Two of the scales which he utilized are 
shown in tables 3 and 4. The second task was two-axis in nature and will not 
be discussed here. Two pilots participated in the experiments. Since describ- 
ing function results for only one of the pilots were published, only the data 
for that subject was used in the modeling to be described. 


Optimal Pilot Modeling 

The equations which define the optimal pilot model follow: 
system state equations 


x(t) = A x(t) + jB u(t) + w(t) 
E [ w(t) w'^(t + g) ] = _F 6 (o) 
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where x(t) represents the state, u(t) the pilot's control output before his 
time delay and neuromuscular dynamics are encountered and w(t) white noise 
disturbances to be described. 


(1) The controlled element dynamics, are described in general as 


Y^(s) 


s(s + b) 


where Kg, a and b are given, in table 2. Note that the Kg/s dynamics are 
represented as Kg (40)/s(s + 40) for computational simplicity. The addi- 
tional first-order denominator with break frequency of 40 rad/sec is well 
beyond the bandwidth of interest for this study. 


(2) The sinusoidal input was represented by white noise with unity 
covariance passed through an appropriate shaping filter. The filter was 
chosen such that the frequency distribution of its output power closely matched 
the frequency distribution of power of the sinusoidal input, 0c- Figure 4 
shows this matching. The filter transfer function is given by 

g2 + 3s + 2.25 


The necessity of using a second-order filter as opposed to one of first-order 
stems from the fact that a state variable corresponding to the time rate of 
change of the input was needed in defining one of the observed variables 
(error rate) . 


(3) The pilot's effective time delay was modeled by a second order Fade' 
approximation as 


-TS _ (s - 4/-t)^ 
^ (s + 4 /t)^ 


(4) The pilot's neuromuscular dynamics were modeled as a first order lag 

1 


62(3) = 




This is dynamically equivalent to including a weighting on control rate in the 
index of performance and adjusting the weighting coefficient on this term to 
yield a predetermined value of Tjj [1]. In this study, the control rate term 
is not included in the index of performance, however. 

(5) The motor noise, v^n(t) is white in nature with covariance 


E[Vjjj(t) v^(t + a)] = p'irE [u(t) u^(t + q) ]5(o) 

Here p' is the predetermined noise-signal ratio for the motor noise. 
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observation equations 


- z (t) = H x(t) + v(t) 

E [w(t) w'^(t + g) = ^ 6(a) 

where H x(t) represents the vector of variables displayed to or perceived by 
the pilot and v(t) the vector of observation noises. The covariance of the 
individual observation noises is given by 

p .'irE[z'. (t) z!(t + a)]6(a) 

E[v. (t) V. (t + a) ] = — 

^ ^ f2(zp 

where z' (t) = H x(t) and is the noise-signal ratio associated with the 

i*-^ observed variable and f(zp is the amplitude'-dependent pure-gain 
Gaussian- input describing function for a threshold- type nonlinearity asso- 
ciated with the i^^ observed variable [16]. This nonlinearity models pilot 
indifference thresholds on the observed variables [2], Since there is only a 
single display indicator for the single-axis task, no task interference 
occurs and the model for task interference [4,17] need not be employed. 

index of performance 


J = E< 


lim 


^ ^ y(t) + u^(t) R u(t) ]dt 


where y(t) is given by y(t) = C x(t) and u(t) is the pilot's output 
before his effective time delay and neuromuscular dynamics are encountered. 
Table 5 gives the general form of the matrices which constitute the problem 
definition. 


Modeling Results 

The pilot modeling to be described was aimed at analytic duplication of 
the tracking experiments described in [13]. Particular attention was paid to 
ensuring that the asstimptions of the rating hypothesis were met: 

(1) In an attempt to obtain a dynamically representative model of the 
human pilot, model parameters were selected so that a fair match existed 
between experimental and analytical RMS error scores. After the match was 
verified, the experimental and analytical describing fimctions were compared. 

(2) The variables selected for inclusion in the index of performance 
were error, 9g(t), and optimal control motion, u(t), both observable by the 
pilot . 
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(3) The weighting coefficients in the index of performance- were chosen 
as the squares of the reciprocals of the estimated maximum "allowable" devia- 
tions of the problem variables. 

Table 6 presents the nominal (a-priori) pilot model parameters used in 
the study. As indicated in table 6, all problem variables are expressed in 
terms of equivalent display indicator movement in cm. For example, control 
stick movement of 1.0 cm refers to the control stick movement which would 
yield a display indicator movement of 1 cm with a controlled element 
Yq = 1.0 cm/ cm and 9c.(t) = 0. 

Table 7 lists the pilot model parameters that yielded the error scores of 
figure 5. This figure illustrates a comparison of RMS error scores from [13] 
and those from the modeling procedure. Figures 6-9 show four representative 
measured and model generated open-loop describing functions YpY^Cjm). 

Finally, figures 10 and 11 illustrate the rating functions R(J)g for the 
Cooper and Cooper-Harper rating scales. 


Discussion 

The values of t, Tn, and p shown in' table 6 were chosen on the basis of 
values found in [1] for similar tasks. The t value was chosen somewhat 
smaller, 0.1 sec rather than the 0.15-0.18 sec in [1]. The noise-signal ratio 
p', however, was selected considerably larger than the 0.003 value proposed in 
[1] since the experiments of [13] used a spring restrained control stick 
whereas the experiments in [1] used an ideal force manipulator. The nominal 
Indifference thresholds of 0.5 cm and 0.5 cm/sec (0.63 deg and 0.63 deg/sec of 
visual arc) represent subjective estimates. These values are considerably 
larger than values normally associated with physiological thresholds, e.g., 

0,05 deg and 0.05-0.1 deg/ sec of visual arc. 

The variables and weighting coefficients appearing in the index of per- 
formance represent subjective estimates of what constitute pertinent problem 
variables and maximum allowable de'vlations. The maximum allowable deviation 
on error was chosen as 1.0 cm, somewhat larger than the 0.75 cm, criterion 
value stated in the instructions to the pilot. 

The rule of thumb used in adjusting the nominal pilot model parameters of 
table 6 to achieve a dynamically representative model of the human pilot was 
as follows : 

Change as few of the nominal parameters as little as possible in order to 
achieve a satisfactory match between experimental and analytical RMS error 
scores. After doing this for all the .controlled elements in question, compare 
the experimental and analytical open-loop describing functions. If a 'reason- 
able match is obtained in the describing function comparison, assume dynam- 
ically representative models of the pilot have been obtained . 

As figure 5 indicates, the RMS error matching was quite good with the 
exception of the 10 Kg/s^ point. Table 7 shows that, with the exception of thq 
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0.1 Kg/s^ task, the only nominal pilot model parameter which was altered was 
p', the noise-signal ratio for the motor noise. In the 0.1 Kg/s^ case, the 
indifference thresholds on error and error rate were increased to 2.0 cm and 
2.0 cm/sec, respectively. The low value of the experimental RMS error for the 
10 Kg/s^ is suspect. In [13], the recorded normalized mean square error 
(0g^/0j,^) for this run is an o rder of magnitude below that for an id entic al 
controlled element with = 0.5 cm. The mean square error for = 1.5 cm 

was not recorded, and the author assumes that this indicates saturation of the 
analog integrator providing 0g^, i.e., a normalized mean square error score 
even greater than that for the 0.5 cm input case. This incongruity led the 
author to ignore the RMS comparison for this case. The reduction of p' as 
the controlled elements become more difficult, i.e. as the non-zero pole in 
the controlled element moved toward the origin, is a reasonable parametric 
variation. This reduction corresponds to more precise control motion with 
increasing task difficulty. 

The analytic increase in the indifference thresholds for the 0.1 
case is, to some extent, corroborated by the fact that the experimentally • 
determined "relative remnant" from [13] for this element is lowest of the 
seven elements studied here. The relative remnant is defined as the ratio of 
the amount of power in the control stick output which is linearly correlated 
with the system input to the total power in the control stick output. Thus, 
when the relative remnant is small, the pilot is introducing a considerable 
amount of "noise" either through nonlinearities (e.g., indifference thresholds) 
time variations, or direction noise injection. The relative remnants, denoted 
pfc are shown in figures 6-9 for the respective controlled elements. The 
for the 0.1 Kg/s^ is 0.387, and considerably smaller than those for the other 
tasks. No describing function comparison for this element was possible since 
the experimentally determined describing function from [13] was unreliable due 
to poor signal-to-noise ratios. 

The describing function comparisons of figures 6-9 are generally good. 

The phase comparisons indicate that a larger effective time delay should have 
been utilized in the analysis, say on the order of 0.15 to 0.2 secs. For the 
purposes of this study, however, the predicted describing functions were con- 
sidered acceptable. 

The seven points in each of the rating curves of figures 10 and 11 were 
obtained by plotting th^ value of the index of performance, J, resulting from 
the modeling procedure versus the assigned pilot rating for each of the seven 
controlled elements under study. The curves are similar, but not identical in 
shape. Thus, it does appear that rating functions of the form R(J)g exist 
for single-axis compensatory tracking tasks, employing a single controller and 
display element. The object of the following sections is to ascertain whether 
the curves can be used to generate ratings and handling qualities levels for 
more complex tasks. 
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EXAMPLE 1. UH-IH HOVER 


Vehicle/Task Description 

This task involved the simulated longitudinal control of a UH-IH unaug- 
mented helicopter in hover, in the presence of longitudinal turbulence. The 
pilot’s task involves keeping the vehicle over the center of a square landing 
pad 15.2 m (50 ft) on a side. The pilot must also keep the vehicle at a 
prescribed height above the ground. The value of this datura height is immate- 
rial in this analysis, save that the vehicle is not in ground effect. The 
pilot has two controls, the longitudinal cyclic and the collective pitch. 

The fixed base pilot-in-the-loop simulation of the longitudinal task was 
conducted on the Naval Postgraduate School's hybrid computer. The vehicle 
dynamics were simulated on the analog computer, the displays were generated on 
a stroke-written CRT graphics terminal with the digital computer driving the 
display elements. Table 8 lists the vehicle aerodynamic data. Table 9 shows 
the turbulence spectrum. Figure 12 shows the display format. In the "base- 
line" configuration, the flight director bar was omitted. In the "director" 
configuration, it was included. The .director signal was synthesized using the 
methods of [18] and will not be discussed here. The nominal eye-to-display 
distance was 0.762 m (2.5 ft). The cyclic control device was a spring- 
restrained aircraft-type center stick with a force-displacement gradient of 
3.50 newtons/cm (2 Ib/in.). The collective control was a device restrained 
only with an adjustable friction brake set to give a breakout force of 
2.22 newtons (0.5 lbs). 

A single well trained UH-1 pilot was utilized in the experiment. After 
considerable training, twenty data runs were taken, each of 90 sec duration, 
using the baseline and director displays. The displays were presented in 
alternate fashion, five runs with the baseline, then five with the director, 
etc. The performance measures recorded were RMS measures of longitudinal dis- 
placement from the pad center, x, longitudinal groundspeed, x, pitch attitude, 
0 , time rate of .change of pitch attitude, 6 , altitude deviation from the nomi- 
nal,^ h, altitude rate, h, cyclic control motion, 65 , and collective control 
motion, 6 q. In addition, pilot opinion ratings were elicited using the 
Cooper-Harper scale of table 4. 


Optimal Pilot Modeling 

With three exceptions, the general form of the optimal pilot model for 
the hover is identical to the form of the model used to obtain the rating 
functions. These exceptions are: 

(1) The pilot’s effective time delay was modeled by a first order Pade’ 
approximation : j 

-TS _ (s - 2 /t) 

^ ‘ (s + 2 /t) 
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(2) The motor noise for the collective control contains a residual term 
which does not scale with the variance of the control motion, U 2 (t), 

where Vjjj^(t) is the white motor noise whose intensity scales with the var- 
iance of U 2 (t) and r(t) is the residual white noise term. 

(3) Task interference was considered in selecting the noise-signal 
ratios, pj^, for the observed variables. 

The reduction in the order of the Fade’ approximation was done to reduce 
the total nuinber of state variables for computational efficiency. The neces- 
sity of including residual motor noise on the collective was based upon the 
unrealistically small collective motion and vehicle vertical motion which 
resulted in the modeling procedure when this noise was not included. In retro- 
spect, such behavior should have been expected. With the horizontal turbulence 
primarily exciting the vehicle's horizontal translation and pitch attitude 
mode, the optimal control policy for the collective was essentially to keep 
the device at its still-air trim position. In reality, however, this trim 
position is never known precisely by the pilot. Off-nominal collective posi- 
tion excites the vertical translation mode of the helicopter which the pilot 
then corrects with further collective motion, etc. To model this trim uncer- 
tainty, the residual noise was added to the control U 2 (t) (the pilot's col- 
lective motion before his time delay and neuromuscular dynamics are encoun- 
tered) . The covariance of the residual noise was set to 1.0 cm^, where here 
the cm units refer to control motion measured at the pilot's hand. This value 
was chosen by assuming that the pilot has an average uncertainty (±lo value) 
of ±1.0 cm in collective trim position for the baseline. -For the director 
configuration, a value of ±0.75 cm was found to yield better RMS performance. 

In contrast to the situation in which the pilot need only concern himself 
with a single task, e.g., control of an aircraft's pitch attitude, task inter- 
ference implies the pilot tracking behavior and performance which accompany 
shared attention, e.g., control of both pitch attitude and altitude deviations. 
The model for task interference does not imply pilot scanning behavior, how- 
ever. Just as in [4], the effects of task interference were modeled as an 
increase in the nominal noise-signal ratios for each observed variable. -Thus, 



where 

p . = noise-signal ratio associated with the i^^ observed quantity when atten- 
tion is being shared 

p = noise-signal ratio associated with "full attention" to the i^^ display 
f^ = fraction of attention devoted to the control task as a whole 
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fg = fraction of attention- devoted to sub- task *s', e.g., longitudinal control 

f. = fraction of attention devoted to the 1^^ observed quantity in sub-task 
’s*, e.g., control of pitch attitude in the longitudinal sub-task. 

In the baseline configuration for the display of figure 12, there are 
three displayed quantities and three perceived quantities. The displayed 
quantities are: 

(1) the longitudinal displacement of the helicopter from the center of 
the landing pad, x 

(2) the pitch attitude, 0 

(3) the altitude deviation of the helicopter from the datum, h. 

• • « 

The three perceived qmntities are x, 8, and h, the time derivatives of the 
displayed quantities. No task interference is assumed to occur between dis- 
played and perceived variables, only between displayed variables [17]. Thus, 
a displayed quantity and its time derivative have the same p^. 

In modeling for the hover task, 

f '= 1.0 f ■= 1,0 f. = 0.333 i = 1,2,3 
t s X 

Thus, the pilot is assumed to be devoting all his attention to the control 
task, all of -the 'control task attention to the longitudinal task and 1/3 of 
the longitudinal task attention to each of the three displayed quantities. 

The f^ and fg values are obvious choices in light of the simulation scenario. 
Normally, the fj^ are" chosen on the basis of a set which minimizes the index 
of performance, J, and which satisfies the constraints 


n 

E 

fi = 

1.0 


i=l 

fi > 

0. 

i = 1,2, . . . n. 


n = number of displayed quantities 

Although an efficient algorithm "for solving for the optimum f^ has recently 
been developed [19], it was assumed in this analysis that each of the three 
displayed quantities received equal attention. The performance comparison to 
be made indicates that this was not an unreasonable choice. 

In the director configuration for the display of figure 12, it was 
assumed that there are two displayed quantities and two perceived quantities. 
The displayed quantities are: 

the cyclic director signal, 6^^ 

the altitude deviation of the helicopter from the datum, h. 


BlPBODUCIBILirY OP THl 
PAGE IS POOE 


( 1 ) 

( 2 ) 

/ 
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• • 

The two perceived quantities are 6g and h, the time derivatives of the 
displayed quantities. Here ^ 

f =1.0 f “ 1.0 f. =0.5 i = 1,2 

t s X 

Here, the pilot is assumed to devote all of his attention to the control task, 
all of the control task attention to the longitudinal task and 1/2 of the 
longitudinal task attention to each of the displayed quantities and h. 


Modeling Results 

The pilot modeling was aimed at analytic duplication of the tracking 
experiments for the TJH-IH hover. Again, attention was paid to ensuring that 
the assumptions of the rating hypothesis were met: 

(1) In an attempt to obtain a dynamically representative model of. the 
human, pilot, model parameters were selected so that a fair match existed 
between experimental and analytical RMS error scores. 

(2) The problem variables selected for inclusion in the index of per- 
formance were 

(a) the longitudinal displacement of the helicopter from the center 
of the landing pad, x 

(b) the groundspeed, x 

(c) the altitude deviation of the helicopter from the datum, h 

(d) the altitude rate, h 

(e) the cyclic control motion, u. (before neuromuscular system, 
etc.) 

(f) the collective control motion, u„ (before neuromuscular system, 
etc.) 


The same index of performance was used in both the baseline and director 
analyses. Although it was assumed that the pilot did not use x and x for 
control purposes in the director configuration, they were observable by the^ 


pilot, i.e., he could monitor these variables while using 6 
for control. 


D 




h and h 


(3) The weighting coefficients in the index of performance were chosen 
as the squares of the reciprocals of the estimated maximum "allowable" devia- 
tions of the problem variables observable by the pilot. 

Table 10 presents the final pilot model parameters us.ed in the study. 

The nominal (a-priori) parameters differ only in the ^ and R matrices. 

Figure 13 illustrates the comparison of RMS tracking scores for experiment and 
analysis. As the figure indicates, a fair comparison exists for the tracking 
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scores. The most serious model deficiency lies in the low predictions of the 
EMS values of the horizontal velocity h. For the purposes of this study, 
however, the predictions were felt to he acceptable. 


Discussion 

The values of x, Tjj, and p shown in table 10 were chosen as follows: • 
The time delay x and neuromuscular time constant Tjj were chosen as 0.2 sec 
rather than the 0.1 sec value used in section 2. It was felt that the larger 
values were more realistic and agreed more closely with values typically used 
in the literature. The p value is that recommended in the literature [1]. 
The noise-signal ratio p ’ was set to 0.01 for the same reason outlined pre- 
viously, the nature of the control devices. The selection of the covariance 
for the collective residual motor noise has been discussed. The indifference 
thresholds represent subjective estimates. The weighting coefficients were 
selected on the basis of reasonable maximum allowable deviations of the per- 
tinent variables and the ability of these deviations to yield acceptable RMS 
tracking scores. Only these values were changed from a-priori selections to ' 
achieve acceptable RMS performance comparisons. Based upon these comparisons, 
it was assumed that a d)mamically representative model* of the human pilot had 
been obtained. The pilot and model generated (via fig. 11) numerical opinion 
ratings are shown below. 


RATINGS 


Display 

Pilot 

Model 

baseline 

A6 

A6.2 (J = 0.73) 

director 

A4 

A4.2 (J = 0.40) 


The correlation is quite acceptable, offering encouraging evidence that the 
rating hypothesis is reasonable. If one uses the experimentally determined 
mean RMS scores to form an index of performance equivalent to the analytical 
one, the resulting ratings are A6.2 and A5.2 for the baseline and director 
displays respectively. Again, the results are encouraging. 


EXAMPLE 2. UH-IH LANDING APPROACH 


Vehicle/Task Description 

This task involved the simulated longitudinal control of a UH-IH unaug- 
mented helicopter in a landing approach at a nominal 30.9 m/sec (60 kt) 
groundspeed on a -6° glideslope in the presence of longitudinal and vertical 
turbulence. Unlike the UH-IH of example 1, this vehicle had no stabilizer 
bar, a device attached to the rotor hub which provides pitch and roll damping. 
The pilot's task involves maintaining the nominal groundspeed and glideslope 
by using cyclic and collective control motion. Only longitudinal motion was 
considered. 
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The fixed base pilot-in-the-loop simulation of the task was conducted on 
the Naval Postgraduate School’s hybrid computer. As in the hover task, the 
vehicle dynamics were simulated on the analog computer, the display was gener- 
ated on a stroke-written CRT graphics terminal with the digital computer driv- 
ing the display elements. Table 11 lists the vehicle aerodynamic data. 

Table 12 shows the turbulence spectra. Figure 14 shows the display format. 

The eye-to-display distance and control stick characteristics were identical 
to those outlined in example 1. 

A second, well trained UH-1 pilot was utilized in the experiment. After 
considerable training, ten data runs, each of 90 sec duration, were taken. 

Five of the "best" runs were then selected on the basis of a weighted sum of 
the RMS performance measures recorded: groundspeed deviation^ from the nominal, 

u, pitch attitude, 9, time rate of change of pitch attitude, 6, deviation from 
glideslope, h, cyclic control motion, 6g, and collective control motion, 

No pilot opinion was elicited in this experiment. Rather, the appropriate, 
handling quality level was deduced from [15] using the following vehicle 
phugoid and short-period characteristics: 

cOp = 0.41 rad/sec Cp = -0.15 

o)gp = 1.05 rad/sec ?gp = 0.85 

The ability of the proposed rating scheme to generate a pilot opinion con- 
sonant with the handling quality level was then ascertained. 

The following level definitions are from Section 1.5 of [15], where the 
landing approach task under study falls into Flight Phase C: 

Level 1: Flying qualities clearly adequate for the mission Flight Phase. 

Level 2: Flying qualities adequate to accomplish the mission Flight 

Phase, but some Increase in pilot workload or degradation in mission effective- 
ness, or both, exists. 

Level' 3: Flying qualities such that the aircraft can be controlled 

safely, but pilot workload is excessive or mission effectiveness is inadequate, 
or both. Category A Flight Phases can be terminated safely, and Category B 
and C Flight Phases can be completed. 

The association between the handling qualities Levels and the Cooper- 
Harper scale utilized in this study is outlined in [20] as: 

Level Cooper-Harper Scale 

1 • 1.0 - 3.5 

2 3.5 - 6.5 

3 6.5 - 9.0+ 

The specific level in which the vehicle of this study can be categorized 
is found from Section 3.2.2 of [15]: 
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Level 1: All aperiodic responses (real roots of the longitudinal charac- 

teristic equation and the lateral-directional characteristic equation) shall 
be stable. Oscillatory inodes of frequency greater than 0.5 rad/sec shall be 
stable. Oscillatory modes with frequency less than or equal to 0.5 rad/sec 
may be unstable provided the damping ratio is less unstable than -0.10. 
Oscillatory modes of frequency greater than 1. 1 rad/sec shall have a damping 
ratio of at least 0.3. 

Level 2: For those Flight Phases of the operational missions of 3.1.1 

for which IFR operation is required, the Level 2 requirement is the same as 
for Level 1. In all other cases, for Level 2, divergent modes of aperiodic 
response shall not double amplitude in less than 12 sec. Oscillatory 
modes may be unstable provided their frequency is less than or equal to 
0.84 rad/sec and their time to double amplitude is greater than 12 sec. 
Oscillatory modes of frequency greater than 0.84 rad/sec shall be stable. 

Level 3: Divergent modes of aperiodic response shall not double ampli- 

tude in less than 5 sec. Oscillatory modes may be unstable provided their 
frequency is less than or equal to 1.25 rad/sec and their time to double ampli- 
tude is greater than 5 sec. Oscillatory modes of frequency greater than 
1.25 rad/sec shall be stable. 

Adhering strictly to these criteria, one sees that the vehicle fits into 
Level 3: 

(1) Level 1 is eliminated since the unstable oscillatory mode has a 

damping ratio ? = -0.15 which is more unstable than -0.10. 

ir 

(2) Level 2 is eliminated since IFR conditions are specified, i.e., an 
integrated CRT display is being utilized in the simulation. 

(3) Level 3 conditions are easily met since oscillatory unstable modes 
may have frequencies up to 1.25 rad/sec and time to double amplitude as small 
as 5 sec. For this vehicle’s unstable mode: 

(Dp = 0.41 rad/sec 

Tjj = time to double amplitude = 11.2 sec 


Optimal Pilot Modeling 

With three exceptions, the general form of the pilot model for the land- 
ing approach is identical to the form of the model used to obtain the rating 
functions. These exceptions are: 

(1) Task interference was considered in selecting the noise-signal 
ratios, p^, for the observed variables. 

(2) No indifference thresholds were utilized in the model. Instead 'the 
"full attention" noise-signal ratio, p, was set to 0.08 rather than 0.01. 
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(3) The time rate of change of groundspeed, u, was assumed not to be 
observed by the pilot. 

The displayed quantities for the approach -task are: 

(1) the groundspeed deviation from nominal, u. 

(2) pitch attitude, 6. 

(3) deviation from glideslope,- h. 

• • 

The perceived quantities are 6 and h, the time derivatives of 0 and h. The 
model for task interference, as outlined in example 1, was utilized here. 

Since the groundspeed symbology of figure 14 was effectively integrated into 
the aircraft symbol, it was assumed that there were but two displayed quanti- 
ties for the purposes of task Interference: 0 and h. In contrast to the 
methods of example 1, the fj^, i = 1,2, were selected on the basis of the 
values which minimize the index of performance subject to the constraint 

2 

2^ = 1.0 > 0 i'= 1,2 

1=1 

It was found that fj^ = f 2 = 0.5. 

The experimental and analytical work devoted to this landing approach 
task predates the work of the previous sections. The omission of display 
thresholds in favor of a larger full attention noise-signal ratio merely char- 
acterizes this early analysis. 

As figure 14 indicates, groundspeed deviations are indicated by the 
pivoting "wings" on the aircraft symbol. When the proper groundspeed is 
achieved, the wings and aircraft symbols are colinear. It was felt that such 
an implicit zero reference would severely hamper rate perception. There are 
several analytical means of modeling this perception problem, from the inclu- 
sion of a large indifference threshold on perceived groundspeed rate to the 
exclusion of groundspeed rate from the list of perceived variables. For sim- 
plicity, the latter technique was used here. 


Modeling Results 

Again attention was paid to ensuring that the assumptions of the rating 
hypothesis were met. 

(1) In an attempt to obtain a dynamically representative model of the 
human pilot, model parameters were selected so that a fair match existed 
between experimental and analytical RMS performance. 

(2) The problem variables selected for inclusion in the index of per- 
formance were 
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- (a) ■ groundspeed deviation from nominal, u. 

« 

(b) pitch rate, 6. 

(c) the cyclic control motion, Uj (before neuromuscular system, etc.) 

(d) the collective control motion, U 2 (before neuromuscular system, 
etc. ) 

(3) The weighting coefficients in the index of performance were chosen 
as the squares of the reciprocals of the estimated maximum "allowable" devia- 
tions of problem variables observable by the pilot. 

Table 13 presents the pilot model parameters used in the study. Only the 
noise-signal ratio, p, and R weighting matrix choices were modified from 
a-priori choices to obtain acceptable comparisons. Figure 15 Illustrates 
the comparison of RMS tracking scores for experiment and analysis.^ As the 
figure indicates, a good comparison exists with the exception of 6. Despite 
the 6 discrepancy, the predictions were felt to be acceptable. 


Discussion 

The values of x and Tjj were chosen for reasons identical to those of 
example 1. Based upon the experimental RMS scores, the observation noise for 
full attention, p, was chosen as 0.08 (as opposed to the 0.01 value normally 
used) . This larger value effectively compensates for the lack of indifference 
thresholds in the model. The motor noise, p', is Identical to the value 
recommended in [1]. Again, this analysis and experiment predate those 
described in the previous sections, in which indifference thresholds and a 
larger p' were utilized. The weighting coefficients for the index of perfor- 
mance were selected on the basis of reasonable maximum allowable deviations of 
the pertinent variables and the ability of these coefficients to yield accept- 
able RMS tracking scores. With the exception of 0, the RMS comparisons indi- 
cate a fair match. The cause of the 0 discrepancy was not determined. Based 
upon the RMS performance comparisons alone, it was assumed that a dynamically 
representative model of the human pilot had been obtained. 

The actual and model generated flying qualities levels are shown belox'/. 


Flying Qualities Level 


Actual 

Model 

Level 3 
(6.5 - 9.0^) 

Level 3 

(6.6) (J = 0.60) 


The 6.6 Cooper-Harper rating lies just within the Level 3 as described pre- 
viously. Since the vehicle easily meets the Level 3 criteria, the 6.6 rating 
represents a very acceptable prediction. If one uses the experimentally 
determined mean RMS scores in an index of performance equivalent in form to 
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the analytical one, the resulting rating is 7.0. Again, an acceptable rating 
is obtained. 


EXAMPLE 3. H-19 HOVER 


Vehicle/Task Description 

This task involved the simulated longitudinal control of an H-19 helicop- 
ter in both unaugmented and augmented configuration in hover, in the presence 
of longitudinal turbulence. The pilot's task involved keeping the vehicle 
over the center of a landing pad. The following task definition was given to 
the pilots: 

"Hover over a spot on the ground maintaining position within 
±1.22 m (±4 ft) using piloting techniques appropriate for VFR 
flight in a gusty environment.. No altitude or lateral control 
required. " 

Details of the simulation can be found in [14]. Table 14 lists the 
vehicle aerodynamic data. Table 15 shows the turbulence spectrum. Figure 16 
shows the display symbology pertinent to this study. No eye-to-display dis- 
tance was stated in [14]. The control stick was a s'tandard aircraft-type cen- 
ter stick was a force gradient of 2.4 newtons/cm. The data for a single pilot 
(denoted pilot 's' in [14]) was used. Two H-19 configurations were utilized. 
One, an unaugmented vehicle, the second, a vehicle with an attitude augmenta- 
tion system as outlined in table 14. 


Optimal Pilot Modeling 

With two exceptions, the general form of the optimal pilot model was 
identical to the form of the model used to obtain the rating functions. These' 
exceptions are; 

(1) The pilot's effective time delay was modeled by a first-order Fade' 
approximation; 


(s - 2/t) 
(s + 2/x) 


(2) Task interference was considered in selecting the noise-signal 
ratios, p^, for the observed variables. 

The displayed quantities for the hover task are; 

(1) the longitudinal displacement of the helicopter from the center of 
the landing pad, x. 


(2) the pitch attitude, S. 
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• • 

The perceived quantities are x and 8, the time derivatives of the displayed 
quantities. Equal allocation of attention between the displayed quantities 
X and 0 was assumed. Thus 

f^ =1.0 f = 1.0 f. =0.5 i = 1,2 
II s ^ 


Modeling Results 

Again, attention was paid to ensuring that the assumptions of the rating 
hypothesis were met: 

(1) In an attempt to obtain dynamically representative models of the 
human pilot, model parameters were selected so that a fair match existed 
between experimental and analytical RMS error scores. 

(2) The problem variables selected for inclusion in the index of perfor- 
mance were: 

(a) longitudinal displacement of the helicopter from the center of 
the landing pad, x. 

(b) the groundspeed, x. 

(c) the cyclic control motion, u (before neuromuscular system, etc.) 

(3) The weighting coefficients in the index of performance were chosen 
as the squares of the reciprocals of the estimated maximum "allowable" devia- 
tions of problem variables observable by the pilot. 

Table 16 presents the final' pilot model parameters used in the study. 
Considerable adjustments in the a-priori values of the Q and R matrices and 
indifference thresholds were needed to achieve acceptable RMS performance com- 
parisons. Figure 17 illustrates the comparison of RMS tracking scores for 
experiment and analysis. The experimental scores and corresponding ratings 
are from the first two runs of pilot 's’ in [14]. As the figure indicates, a 
good comparison exists. ’ As table 16 shows, only the pilot indifference 
thresholds were changed in going from the unaugmented to the augmented vehicle. 


Discussion 

The values of t, Tjj, p, and p’ in table 16 were chosen identical to 
those of example 1. The weighting coefficients for tlie index of performance 
and the thresholds were selected so as to yield acceptable RMS performance 
comparisons with experiment. The final maximum allowable- deviations and indif- 
ference thresholds for this example are, in general, much smaller than those 
for the UH-IH hover task’ of example 1. These smaller values are a reflection 
of the fact that the RMS performance scores are much lower for the H-19 than 
for the TJH-IH vehicle. On the basis of the performance comparisons of 
figure 17, it was assumed that a dynamically representative model of the pilot 
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had been obtained. The pilot and model generated numerical opinion ratings 
are shown below. 


RATINGS 


Vehicle 

Pilot 

Model 

H-19 

H-19AA 

(augmented) 

U8 

A4.5 - 5.0 

U8 (J = 2.63) 
A5 (J = 0.48) 


If the experimentally determined mean RMS scores are used in an index of 
performance equivalent in form to the analytical one, ratings of 9.0 and 5.5 
are obtained. While these values are somewaht high, they are still acceptable. 


CONCLUSIONS AND RECOMMENDATIONS 


It was the purpose of this study to test the rating hypothesis by modeling 
the human pilot in four specific flight tasks in-which experimental RMS perfor- 
mance measures and pilot ratings were available or could be inferred. In 
general, the results indicate that the hypothesis is reasonable. More corre- 
lation between experimental and analytical work along the lines of examples 1-3 
is obviously needed. However, even if positive correlations are forthcoming, 
the ability to use the rating scheme in a predictive capacity still will hinge 
upon discerning whether the criteria stated in the rating hypothesis have been 
met. Even with simulation results (RMS performance, describing functions, * 
etc.), this can involve a good deal of educated guessing. For example, the 
modeling of the pilot in the DH-IH baseline experiment required seventeen 
parameters to be specified (see table 10) . The situation is further aggra- 
vated by the fact that no procedure now exists for identifying all the optimal 
pilot model parameters from simulation data [21], The majority of modeling to 
date has been accomplished in a manner similar to that pursued here, i.e., 

RMS performance matching. 

Thus the potential of the analytical rating technique which has been dis- 
cussed is eroded by the lack of a well defined procedure for selecting pilot 
model parameters, a priori, given a specific vehicle and task, and by the 
Inability to identify these pilot model parameters, a posteriori, given simula- 
tion data. One can, however, suggest a procedure for selecting the parameters 
which minimizes the guesswork involved; 

(1) Select T, Tjj, p, and p' as 

T = Tj;j = 0.2 sec 

p = p' = 0.01 

(2) Select the maximum allowable deviations of each observed variable in 
the index of performance as that deviation producing a display indicator 
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movement which subtends a specific visual arc or arc rate, at the pilot's eye. 
The data of this study indicate that 1-2 deg and 1-2 deg/ sec appear to be 
reasonable values. For the control movement, select the maximum allowable 
deviation as a specific percentage of the maximum control motion possible, 

25 percent being a reasonable figure. 

(3) Select the indifference thresholds on each observed' variable to be 
a specific percentage of the visual arc and arc rate selected in (2). Here 
again, 25 percent would be a reasonable value. Do not allow these threshold 
values to be smaller than the thresholds associated with visual discrimina- 
tion, i.e., 0.05 deg and 0.05 deg/sec. 

(4) Use the model for task Interference to select the fraction of atten- 
tion for each observed variable. This means finding that set which mini- 

mizes the index of performance subject to the constraints 

n 

2 fj^ = 1.0 > 0 i = 1»2, . . . n 

i=l 

(5) Use the rating scheme to predict general flying qualities levels, as 
done in example' 2, rather than specific numerical ratings. 

A positive demonstration of the utility of this parameter selection pro- 
cedure would significantly enhance the rating scheme offered in this report. 
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TABLE 1 ,- INPUT SINUSOIDS PROM [13] 

* 


Component no. 

Component frequency 
(rad/sec) 

Component amplitude 
A^ (cm) 

1 

0.188 

0.566 

2 

.314 



3 

• .502 



4 

.816 



. 5 

1.19 



6 

1.88 

» 1 


7 

2.89 

.113 

8 

4.77 



9 

7.35 



10 

9.23 



11 

12.2 



12 

15.0 


r 


TABLE 2.- CONTROLLED ELEMENTS FOR EXPERIMENTS AND MODELING OF [13] 


Controlled 

element 

Kb 

(cm/cm-sec )* 

a 

b 

(rad/sec) 

Ref. [13] 


Vs 


0.586 

40. 

40. 

Kg/s(s + 4) 


2.15 • 

1. 

4. 

■ Kg/s(s + 2) 


2.15 

1. 

2. 

K^/s(s + 1) 

Kg a/s(s + b) 

2.15 

1. 

1. . 

Vs2 


1.17 

1. 

0. 

O.lK^/s^ 


1.17 

.1 

0. 

lO.OKg/s^ 


1,17 

10.0 

0. 


*Here n refers to the exponent on . the free s in the denom- 
inator of the transfer function of the controlled element. 
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TABLE 3.- THE ORIGINAL COOPER SCALE 


COOPER 

PR 

Description 

Adj ective 
rating 

Mission 

Primary 

mission 

accomplished? 

Can be 
landed? 

1 

Excellent , 
includes optimum 



Yes 

Yes 

1 

Good, 

pleasant to fly 

Satisfactory 

Normal 

operation 

Yes 

Yes 

2 

Satisfactory, but with 
some mildly unpleasant 
characteristics 



Yes 

Yes 

3 

Acceptable, but 
' with unpleasant 
characteristics 



Yes 

Yes 

1 

Unacceptable 
for normal operation 

S 

Unsatisfactory 

Emergency 

operation 

Doubtful 

Yes 


Acceptable for emer- 
gency operation (stab. ■ 
aug. failure) only 



Doubtful 

Yes 

1 

Unacceptable even for 
emergency condition 
(stab. aug. failure) 



No 

Doubtful 

1 

Unacceptable- 

dangerous 

Unacceptable 

No 

operation 

No 

No 

i 

Unacceptable- 

uncontrollable 



No 

No 

1 

Did not get 
back to report 

Unprintable ' 

What 

mission? 



10 
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TABLE 4.- THE REVISED COOPER-HARPER SCALE 



CIBMY OF THE 
® g IS POOR 


tsJ 

<J\ 


Controllable 

Capable of 
being con- 
trolled or 
managed in 
context of 
mission, 
with avail- 
able pilot 
attention 


Acceptable 

May have defi- 
ciencies which 
warrant improve- 
ment, but ade- 
quate for 
mission. 

Pilot compensa- 
tion, if required 
to achieve 
acceptable per- 
formance, is 
feasible. 


Unacceptable 

Deficiencies 
which require 
mandatory 
improvement . 
Inadequate perfor- 
mance for mission 
even with maximum 
feasible pilot 
compensation. 


Satisfactory 

Meets all require- 
ments and expecta- 
tions, good enough 
with improve- 
ment . 

Clearly adequate 
for mission. 


Unsatisfactory 

Reluctantly 
acceptable. Defi- • 
ciencies which 
warrant improve- 
ment. Performance 
adequate for mis- ■ 
Sion with feasible 
pilot compensation. 


Excellent, highly desirable. 


Good, pleasant, well behaved. 


Fair. Some mildly unpleasant characteristics. 
Good enough for mission without improvement. 


Some minor but annoying deficiencies . Improvement is 
requested. Effect on performance is easily compensated 
for by pilot. 


Moderately objectionable deficiencies. Improvement is 
needed. Reasonable performance requires considerable 
pilot compensation. 


Controllable with difficulty. Requires substantial 
pilot skill and attention to retain control and con- 
tinue mission. 


Marginally controllable in mission. Requires maximum 
available pilot ‘skill and attention to retain control. 


A1 


A2 


A3 


A4 


A5 


Very objectionable deficiencies. Major improvements 
are needed. Requires best available pilot compensation 
to. achieve acceptable performance. 


A6 


Major deficiencies which require mandatory improvement 
for acceptance. Controllable. Performance inadequate 
for mission, or pilot compensation required for minimum 
acceptable performance in mission is too high. 


U7 


U8 


U9 


Uncontrollable 

Control will be lost during some portion of 
mission. 


Uncontrollable in mission 
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TABLE 5 


MATRIX DEFINITIONS FOR MODELING OF EXPERIMENTS FROM [13] 
x(t) vector 

Xj (t) = 0 (t) = controlled element output 

X^Ct) = Xj^(t) = 0(t) 

XgCt) 


x^(t) 


Fade’ approximation states 


control stick motion 


X0(t) = 6g(t) = command input 
x^(t) = Xg(t) = 6gCt) 




0 

0 

0 

0 

0 

0 

0 


1 

-b 

0 

0 

0 

0 

0 


0 

0 

0 

-16/t2 

1/T. 

0 
0 


N 




A matrix 

0 
0 

1.0 
-8/t 
0 
0 
0 

^ matrix 

0 
0 

-16/t 
12Qh^ 


0 

0 

0 

-1/T 
' N 

0 

0 


V- 


1/X 
0 
0 


N 


0 

0 

0 

0 

0 

0 

-2.25 


0 

0 

0 

0 

0 

1 

-3. 


Uj(t) = u(t) 


u(t) vector 

pilot's control motion before time 
delay and neuromuscular dynamics 
are encountered 
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TABLE 5.- MATRIX DEFINITIONS FOR MODELING OF EXPERIMENTS FROM [13] 

Y matrix 


0 

0 

0 

0 

0 

0 

3. 674 


0 

0 

0 

0 

1/T. 

0 

0 


N 



w(t) vector 

= w(t) = shaping filter input 
= v~(t) = motor noise 


F matrix 


[ 1.0 0 

0 p'T7E[u|(t)l 



z’ (t) vector 

e^,(t) - 6(t) = displayed QgCt) 
0j,(t) - 0(t) = perceived 0g(t) 


, v(t) vector 


Vj(t) = additive noise associated with 6g(t) 
V 2 (t) = additive noise associated with 0g(t) 


H matrix 




0 

-1 


[ 


0 

0 

. I 2/ 


0 

0 


0 

0 


G matrix 


piiE[zJ'^(t) ] 
0 


pirE[z2^(t) ] 


:] 

] 


Concluded 
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TABLE 6.- NOMINAL PILOT MODEL PARAMETERS FOR MODELING 


OF 

EXPERIMENTS FROM 

[13] 

Time delay 

T 

0.1 sec 

Neuromuscular time 
constant 

T 

N 

.1 sec 

Observation noise 
noise-signal ratio 

P 

.01 

Motor noise 

noise-signal ratio 

P’ 

.01 

Error indifference 
threshold 

0 

®TH 

.5 cm of display element 
movement 

Error rate indifference 
threshold 

9 

®TH 

.5 cm/sec of display 
element movement 

matrix coefficient 

qii = l/Oe^)^ 

1/(1 cm)^ 

R matrix coefficient 

rii = 

1/(10 cm) 2 * 


*In conforming to the convention of [13], problem variables are 
expressed in terms of equivalent indicator movement. 













TABLE 7.- FINAL PILOT MODEL PARAMETERS FOR MODELING OF EXPERIMENTS FROM [13] 


Controlled Element 

Model parameters which differ from 
nominal (Table 6) 

V" 

p’ = 0.02 

Kg/s(s + 4) 

Same as nominal 

Kg/s(s + 2) 

Same as nominal 

K_/s(s + 1) 

p' = 0.0075 

K^/s2 

p' = .0075 

0.1 K^/s2 

0 =2 cm, 0 =2 cm/sec, p’ = 0.0075 

TH TH 

10.. Kg/s2 

p' = 0.0025 


TABLE 8.- NORMALIZED UH-lH LONGITUDINAL DERIVATIVES IN 
STABILITY AXIS SYSTEM, HOVER 


m* = 3,856 kg 
Uq =0 m/sec 
lyy = 17,279 kg-m^ 
X^, = -0.00934 /sec* 
X,, = -.000418 /sec 
X =5.88 m/sec 

q 

= -.00214 /sec 

Z = -.404 /sec 
w 

Zq = .462 m/sec 


M = 0.00314 /sec— m 
u 

M = -.00477 /sec-m 
w 

M* = 0 /m 
w 

Mq = -2.03 /sec 

X^ =12.5 /sec2 
B 

X. = .00187 /sec^ 

°C 

Zj = -.308 /sec^ 

B 

Zs - -96.1 /sec^ 

C 

Mr = -4.20 /m-sec^ 
°B 

Mg =0 /m-sec^ 


*Force and moment derivatives are normalized with respect 
to mass and moment of Inertia, e.g., 


X = - 
u m 


M 

u 


1 9m\ 

I 3U )n 

yy ^0 
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TABLE 9.- TURBULENCE SPECTRUM FOR UH-IH HOVER 

■ L 1 

g ^ 

0 • (w) = T , r^ 77TV2 m^-rad/sec^ 

u u ' ' Uq 1 + (L oj/Uo)"^ 

g g u 

a -1.52 m/sec (5 ft/sec) 
u 


L^/Uq =3.33 sec* 


*Although Uq = 0 and the "frozen turbulence" hypothesis 
is, strictly speaking, no longer valid, the general form of the 
turbulence spectrum above is retained. For example, one can 
consider Uq = 1.52 m/sec, = 5.06 m. 
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TABLE 10.- FINAL PILOT MODEL PAEAMETERS FOR MODELING 
OF UH-IH HOVER TASK 


Time delay 

T 

0.2 sec 


Neuromuscular time 
constant 

T 

N 

.2 sec • 


Observation noise 
noise— signal ratio 
(full attention) 

P 

.01 


Motor noise 
noise-signal ratio 

P' 

.01 


Covariance of collective 
residual motor noise 

E[r2(t)] 



baseline 


(1.0 cm)^ 


director 


(.75 cm)^ 


Baseline indifference 
thresholds 


• 0,.305 m 
(1 ft) 

(.00133 rad visual 
arc) 


^TH 

0.914 m/sec 
(3 ft/sec) - 

(.00399 rad/sec 
, visual arc) 



0.305 m 
(1 ft) 

(.000667 rad visual 
arc) 


^TH 

0.914 m/sec 
(3 ft/sec) 

(.00199 rad/sec 
visual arc) 


®TH 

0.0175 rad 
(1 deg) 

(.00166 rad visual 
arc) 


®TH 

0.0525 rad/i 
(3 deg/ sec) 

sec (.005 rad/ sec 
visual arc) 

Director indifference 
thresholds 

\ 

TH 


(.00166 rad visual 
arc) 


^TH 


(.005 rad/sec 
visual arc) 


^TH 

0.305 m 
(1 ft) 

(.000,667 rad visual 
arc) 


^TH 

0.914 m/sec 
(3 ft/sec) 

(.00199 rad -visual 
arc) 
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• TABLE 10.- FINAL PILOT MODEL PARAMETERS FOR MODELING 
OF UH^IH HOVER TASK - Concluded 


q,, = l/(x^)2 1/(1. 52 m/sec)^ 

(1/(5 ft/sec) 

q-P = l/(h^)^ 1/(7. 62 m/sec)^ 

“ (1/(25 ft/sec) 2) 

q. = 1-/(0^ 1/(7. 62 m)2 

(1/(25 ft/sec) 

•544 ^ V(hM)^ l/(3.05 m/sec) ^ 

(1/(10 £t/sec)^) 


0 matrix coefficients 



director 

same as baseline 


R matrix coefficients 



baseline 

(cyclic) r^j = l/(u^ 

M 

1/ (6.10 cm)^ 
(l/(.2 ft) 2) 


(collective) r = 1/(0^ )^ 

M 

1/(3. 05 cm) 2 
(l/(.l ft) 2) 

director 

same as baseline 



Q matrix coefficients 
baseline 
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REPRODUCIBILrrY OF THE 

mmMj fmE W 


TABLE 11.- NORMALIZED' UH-IH LONGITUDINAL DERIVATIVES IN 
STABILITY AXIS SYSTEM, LANDING APPROACH 


m = 3,856 kg 

Uq =30.9 m/sec (60 kts) 

I =17,279 kg-m2 

yy 

X =• -0.0242 /sec* 
u 

X •= 0.00603 /sec 
w 

X = 0.472 m/sec 

q 

Z = -0.0719 /sec 
u 

Z = -1.17 /sec 
w 

Z = -0.272 m/sec 

q 


M = 0.0149 /sec-m 
u 

M = “0.00155 /sec-m 
w 

M* = 0. /m 
w 

M = -0.455 /sec 

•X, =12.1 /sec2 

*B 

X- = 0.787 /sec^ 

Z. = 47.1 /sec^ 

Z. = -186. /sec^ 

= -5.18 /m-sec^ 

°B 

Mf. =0. /m-sec^ 


*Force and moment derivatives are normalized with respect 
to mass and moment of inertia, e.g.. 


X 


u 


1 jx'^ 

m 3 u/q 
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TABLE 12.- TURBULENCE SPECTRA FOR UH-IH LANDING APPROACH 


Vertical Turbulence 


$ 

w w 


( 0 )) 


S g 



a =1.52 m/sec (5 ft/sec) 
'"g 

L = 30.5 m (100 ft) 
w 

Uq = 30.9 m/sec (60 kts) 



o =1.52 m/sec (5 ft/sec) 
^g 

L = 183. m (600 ft) 
u 
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TABLE 13.- FINAL PILOT MODEL PARAMETERS FOR MODELING 
OF UH-IH LANDING APPROACH TASK 


Time delay 

T 


0.2 sec 

Neuromuscular time 
constant 

T 

N 


.2 sec 

Observation noise 
noise-signal ratio 
(full attention) 

P 


.08 

Motor noise 
noise-signal ratio 

.P' 


.003 

Q matrix coefficients 

qii 

■ 

l/(3.05 m/sec)^ 

' 


(1/(10 ft/sec)^) 


<l22 

= 1/(V' 

1/ (0.04 rad/sec)^ 


<i33 

= 1/ 

l/(3.05 m) 

(1/(10 ft/sec)^) 

R matrix coefficients (cyclic) 

^11 

= l/(ui^)2 

l/(7.62 cm)^ ' 
(1/(0. 25 ft) 2) 

(collective) 

^22 


l/(3.05 cm) 
(17(0.1 ft) 2) 
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TABLE 14. NOEMALIZED H-19 LONGITUDINAL DERIVATIVES IN 

-r 

‘STABILITY AXIS SYSTEM, HOVER 


m 

= 2,892 kg 

Mu = 

0.0199 sec/m 


Uq 

= 0 m/sec ■ 

11 

-.61 /sec 


^yy 

= 13,080 kg-m^ 

X^ = 

-26.4 /sec^ 


Xu 

= -0.0284 /sec* 

II 

17.9 /m-sec^ 



= 0 m/sec 

Kg = 

.27 cm/ cm** 

(0.41 cm/ cm in aug- 
mented eqns) 


Augmentation Equation 

6^ = 6 - Kg6 - K^u 

= 0 /sec Kg = 10. 


*Force and moment derivatives are normalized with respect to 

mass and moment of inertia, e.g. , 


X 


u 


1 9x \ 
m Bu/q 


Ma = 


1 

lyy 9u/g 


**Control-stick gain. 


'TABLE 15.- TURBULENCE SPECTRUM FOR H-19 HOVER 


0.379 2 w 2 

+ 0.0985 “ 


turbulence intensity = 0.777 m/sec (2.55 ft/sec) 
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TABLE 16.- FINAL PILOT MODEL PAEAMETERS FOR MODELING OF H-19 HOVER TASK 


. Time delay 

T 


0.2 sec 

Neuromuscular time 
constant 

^N 


.2 sec 

Observation noise 
noise- signal ratio 

P 


:01 

Motor noise 
noise-signal ratio 

P' 


.01 

Indifference thresholds 




unaugmented vehicle 

x^H 


0.012 m 
(0.04 ft) 


• 

XjH 


0.036 m/sec 
(0.12 ft/sec) 

. augmented vehicle 

x^H 


0.036 m 
(0.12 ft) 


Xth 


0.073 m/sec 
(0.24 ft-/sec) 


®TH 


0.01 rad 


®TH 


0.01 rad/sec 

^ matrix coefficients 


l/(Xjyj)^ 

1/(0.305 m)2 
(1/(1 ft) 2) 


922 

l/(%)^ 

1/(0.061 m/sec)2 
(1/(0. 2 ft/sec)2) 

R matrix coefficients 

= 

i/CV^ 

l/d.22 cm) 2 

(1/(0. 04 ft) 2) 


38 



















Yc 

TO BE 
EVALUATED | 0 (PITCH) 



6c 

Figure 2.- Single-loop primary task with secondary cross-coupled loading 

task from [l3]. 







DISPLAY LIMITS 


e = ± 3.75 cm 
=±45 deg 

Figure 3.- CRT display for single-loop plus secondary tasks from [l3]. 
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= 1.5 rad/sec 


(t) 
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Figure 4.- Input matching for model and experiments from [13]. 



CVJ o> 



1 !_ L_ I X ^ R 

S S(S+4) S(S+2) S(S+I) g2 g2 g2 


CONTROLLED ELEMENT Yc(s)/K0 

Figure 5.- Comparison of model generated and experimental tracking errors for 

experiments from [l3] , 
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Figure 6.- A comparison of modal generated and experimental open-loop describing 

functions for experiments from [l3] . 
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Figure 7.- A comparison of model generated and experimental open-loop describing 

functions for experiments from [13] , 
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COOPER RATING 


Figure 10. ~ Rating curve for Cobper . rating scale. 



COOPER-HARPER RATING 


Figure 11.- Rating curve for Cooper-Harper rating scale. 



PITCH ATTITUDE 7.87 deg/cm 

GLI DESLOPE DEVIATION 6 m/cm 

LONGITUDINAL DISPLACEMENT 3 m/cm 
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Figure 12.- CRT display for UH-IH Hover. 




Figure 13.- Comparison of model generated and experimental tracking errors for UH-IH Hover. 
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Figure 14.- CRT display for UH-IH landing approach. 
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d EXPERIMENT 


Figure 15.- Comparison of model generated and experimental tracking errors for 

UH-IH landing approach. 
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^Figure 16. ~ CRT display for H-19 Hover. 
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Figure 17.- Comparison of model generated and experimental tracking errors for H-19 Hover. 



